1 



DOCUMENT RESUME 



ED 425 950 



SE 062 121 



AUTHOR 

TITLE 

INSTITUTION 

SPONS AGENCY 

REPORT NO 
PUB DATE 
NOTE 



AVAILABLE FROM 



PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Ree s 0 1 Clyde M. ; Jerry, Laura; Ballator, Nada 

NAEP 1996 Mathematics State Report for Hawaii. Findings from 
the National Assessment of Educational Progress . 

Educational Testing Service, Princeton, NJ. ; National 
Assessment of Educational Progress, Princeton, NJ . 

National Center for Education Statistics (ED) , Washington, 
DC. 

NCES -97-974-HI 
1997-06-00 

2 14p . ,* For overall report, see ED 406 223. For other state 
reports, see SE 062 110-157. "In collaboration with Peggy 
Carr, Jeff Haberstroh, Paul Koehler, Phillip Leung, Mary 
Lindquist, and John Mazzeo." 

National Library of Education, Office of Educational 
Research and Improvement, U.S. Department of Education, 555 
New Jersey Avenue, NW, Washington, DC 20208-5641; Tel: 
800-424-1616 (Toll Free) ; Web site: 
http : //www. ed . gov/NCES/naep 

Numerical/Quantitative Data (110) -- Reports - Research 

(143) 

MF01/PC09 Plus Postage. 

Algebra; Elementary Education; Functions (Mathematics) ; 
Geometry; *Grade 4; *Grade 8; ^Mathematics Achievement; 
Mathematics Education; Measurement; ^National Competency 
Tests; Number Concepts; Probability; Problem Solving; 

Spatial Ability; *Standardized Tests; Standards; Statistics; 
★Student Evaluation; Tables (Data) ; Test Results 
★Hawaii; National Assessment of Educational Progress; State 
Mathematics Assessments 



ABSTRACT 



The National Assessment of Educational Progress (NAEP) is 



the only nationally representative and continuing assessment of what students 
in the United States know and can do in various academic subjects. The 1996 
NAEP in mathematics assessed the current level of mathematical achievement as 
a mechanism for informing education reform. In 1996, 44 states, the District 
of Columbia, Guam, and the Department of Defense schools took part in the 
NAEP state mathematics assessment program. The NAEP 1996 state mathematics 
assessment was at grade 4 and grade 8, although grades 4, 8, and 12 were 

assessed at the national level. The 1996 state mathematics assessment covered 
the five content strands: (1) Number Sense, Properties, and Operations; (2) 

Measurement; (3) Geometry and Spatial Sense; (4) Data Analysis, Statistics, 
and Probability; and (5) Algebra and Functions. In Hawaii, 2,578 students in 
106 public schools were assessed at the fourth-grade level and 2,189 students 
in 51 public schools were assessed at the eighth-grade level. This report 
describes the mathematics proficiency of Hawaii fourth- and eighth-grade 
students, compares their overall performance to students in the West region 
of the United States and the entire United States (using data from the NAEP 
national assessment) , presents the average proficiency for the five content 
strands, and summarizes the performance of subpopulations (gender, 
race/ethnicity, parents' educational level, Title I participation, and 
free/reduced lunch program eligibility) . To provide a context for the 
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assessment data, participating students, their mathematics teachers, and 
principals completed questionnaires which focused on: school characteristics 
(attendance); instructional content (curriculum coverage, standards, amount 
of homework); delivery of mathematics instruction and its characteristics; 
use of technology in mathematics instruction; students’ own views about 
mathematics; and conditions facilitating mathematics learning (hours of 
television watched, parental support, home influences) . On the NAEP fields of 
mathematics scales that range from 0 to 500, the average mathematics scale 
score for fourth grade students in Hawaii was 215 compared to 222 throughout 
the United States and the average mathematics scale score for eighth grade 
students in Hawaii was 262 compared to 271 throughout the United States . The 
average mathematics scale score of fourth grade males did not differ 
significantly from that of females in either Hawaii or the nation. The 
average mathematics scale score of eighth grade males was lower than that of 
females in Hawaii; nationwide, however, the performance of males did not 
differ significantly from that of females. At the fourth grade, White 
students in Hawaii had an average mathematics scale score that was higher 
than that of Black and Hispanic students but was not significantly different 
from that of Asian/Pacific Islander and American Indian students. At the 
eighth grade, White students in Hawaii had an average mathematics scale score 
that was higher than that of Hispanic and Asian/Pacific Islander students. 
(ASK) 
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What is The Nation’s Report Card? 



THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and 
continuing assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted 
periodically in reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student 
performance available to policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition 
and progress of education. Only information related to academic achievement is collected under this program. NAEP guarantees the privacy of 
individual students and their families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified 
organizations. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation studies 
and solicitation of public comment, on NAEP’s conduct and usefulness. 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The Board is 
responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting appropriate 
student performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for 
taking actions to improve the form and use of the National Assessment. 
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Hawaii 



HIGHLIGHTS 



JN^onitoring the performance of students in subjects such as mathematics is a 
key concern of the citizens, policy makers, and educators concerned with educational 
reform efforts. The 1996 National Assessment of Educational Progress (NAEP) in 
mathematics (as well as the two previous NAEP assessments in mathematics in 1990 
and 1992) assessed the current level of mathematical achievement as a mechanism for 
informing education reform. This report contains results for public school students only 
for those years in which Hawaii participated and for which minimum participation rate 
guidelines were met. 

What Is NAEP? 

The National Assessment of Educational Progress (NAEP) is the only nationally 
representative and continuing assessment of what students in the United States know and 
can do in various academic subjects. NAEP is authorized by Congress and directed by 
the National Center for Education Statistics of the U.S. Department of Education. The 
National Assessment Governing Board (NAGB), an independent body, provides policy 
guidance for NAEP. 

Since its inception in 1969, NAEP’s mission has been to collect, analyze, and 
produce valid and reliable information about the academic performance of students in 
the United States in various learning areas. In 1990, the mission of NAEP was expanded 
to provide state-by-state results on academic achievement. Participation in the 
state-by-state NAEP is voluntary and has grown from 40 states and territories in 1990 
to 48 in 1996. 

NAEP has also become a valuable tool in tracking progress towards the National 
Education Goals. The subjects assessed by NAEP are those highlighted at the 1989 
Education Summit and later legislation. 1 The NAEP 1996 assessment in mathematics 
marks the third time the subject has been assessed with the new framework in the 1990s, 
enabling policy makers and educators to track mathematics achievement since the release 
of the National Council of Teachers of Mathematics (NCTM) Curriculum and 
Evaluation Standards for School Mathematics 1 in 1989. 



Executive Office of the President. National Goals for Education. (Washington, DC: Government Printing Office, 1990); 
Goals 2000: Educate America Act, Pub. L. No. 103-227 (1994). 

2 National Council of Teachers of Mathematics. Curriculum and Evaluation Standards for School Mathematics. (Reston, 
VA: NCTM, 1989). 
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Hawaii 



NAEP 1996 Mathematics Assessment 

The NAEP mathematics assessment has been in constant evolution since its 
inception in 1973. Major changes took place in the 1990s to complement the 
Curriculum and Evaluation Standards for School Mathematics , that was published by the 
National Council of Teachers of Mathematics (NCTM) in 1989. The NAEP 1990 
mathematics assessment saw the inclusion of short constructed-response questions — 
questions that asked students to provide the answer they calculated for a numerical 
problem or to write a sentence or two describing the solution to a problem. Also added 
in 1990 were a number of questions on which students could use calculators, protractors, 
or rulers. 

In 1992 the assessment included an increased number of short 
constructed-response questions and, for the first time, contained extended 
constructed-response questions. Extended constructed-response questions required 
students to produce both a solution and a short paragraph describing the solution or its 
interpretation in the context of the task. As such, these questions served as indicators 
of students’ growth in the areas of reasoning, communication, and problem solving — 
important processes receiving heavy emphasis in the NCTM Standards . 

In 1996 the NAEP mathematics assessment continued to be revised, most notably 
by continuing to increase the use of constructed-response questions. In 1990, students 
spent about 30 percent of testing time on constructed-response questions. By 1992, this 
percentage had increased to 35 percent, and in 1996 it exceeded 50 percent of the time 
spent by students on the assessment. 

The 1996 assessment maintained the same five content strands used for the 1990 
and 1992 assessments — Number Sense, Properties, and Operations; Measurement; 
Geometry and Spatial Sense; Data Analysis, Statistics, and Probability; and Algebra and 
Functions. Two of these strands, Number Sense, Properties, and Operations and 
Geometry and Spatial Sense, were revised to reflect the NCTM Standards' emphases 
on developing and assessing students’ abilities to make sense of both number/operation 
and spatial settings. 

The changes made to the NAEP 1996 mathematics assessment refined and 
sharpened the assessment to reflect more adequately recent curricular emphases and 
objectives; to include what teachers, mathematicians, and measurement experts think 
should be in the assessment; and to maintain the connection with the 1990 and 1992 
assessments to permit the measurement of trends in student performance since 1990. 

Tables H.l and H.2 show the distribution of mathematics scores and the 
percentage of students at or above the Basic , Proficient , and Advanced achievement 
levels for fourth- and eighth-grade students attending public schools in Hawaii in 1996. 
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TABLE H.1 — GRADES 4 AND 8 


Distribution of Mathematics Scale Scores for Public School 
Students 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Grade 4 














Hawaii 


215 ( 1.5) 


170 (2.6) 


193 ( 1.9) 


217 ( 1.3) 


239 ( 1 .3) 


258 ( 1 .6) 


West 


219 ( 2.1) 


177(4.0) 


197(2.0) 


220 ( 2.9) 


240 ( 2.6) 


259 ( 2.1) 


Nation 


222 ( 1.0) 


180 ( 1.5) 


201 ( 1 .3) 


224 ( 1.3) 


244 ( 1 .0) 


261 ( 1 .0) 


Grade 8 














Hawaii 


262 ( 1 .0) 


214 ( 2.0) 


238 ( 1.0) 


263 ( 1 .2) 


287 ( 1 .6) 


310 ( 2.2) 


West 


268 ( 2.4) 


219 ( 4.8) 


244 ( 3.0) 


269 ( 1 .7) 


294 ( 3.4) 


314 ( 3.0) 


Nation 


271 ( 1.2) 


222 ( 2.0) 


247 ( 1.2) 


272 ( 1.1) 


296 ( 1 .4) 


316 ( 2.0) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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TABLE H.2 - GRADES 4 AND 8 

Percentage of Public School Students Attaining Mathematics 
Achievement Levels 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



Grade 4 










Hawaii 


2 ( 0.4) 


16(1.1) 


53 ( 1.6) 


47 ( 1 .6) 


West 


2 ( 0.5) 


16 ( 1.8) 


57 ( 3.0) 


43 ( 3.0) 


Nation 


2 ( 0.3) 


20 ( 1 .0) 


62 ( 1 .4) 


38 ( 1 .4) 


Grade 8 










Hawaii 


2 ( 0.4) 


16 ( 0.9) 


51 ( 1.5) 


49 ( 1 .5) 


West 


3 ( 0.6) 


21 ( 2.0) 


58 ( 2.4) 


42 ( 2.4) 


Nation 


4 ( 0.6) 


23 ( 1 .2) 


61 ( 1.3) 


39 ( 1.3) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Hawaii 



Major Findings for Hawaii 

• The average mathematics scale score for fourth graders in Hawaii was 
21 5. 3 This average was lower than that for the nation (222). 

• In terms of achievement levels established for the NAEP mathematics 
assessment, 16 percent of the fourth-grade students in Hawaii performed 
at or above the Proficient level. 4 This percentage was somewhat 
smaller than that of students nationwide (20 percent). 

• From 1992 to 1996 in grade 4, the average scale score of students in 
Hawaii did not change significantly while that of students across the 
nation increased. 

• The average mathematics scale score for eighth graders in Hawaii was 
262. This average was lower than that for the nation (271). 

• In terms of achievement levels, 16 percent of the eighth-grade students 
in Hawaii performed at or above the Proficient level. This percentage 
was smaller than that of students nationwide (23 percent). 

• From 1992 to 1996 for eighth graders, there was an increase in the 
average scale score of students in Hawaii and somewhat of an increase 
in that of students across the nation. The observed increase for Hawaii 
was not significantly different from the increase for, the nation. 

• The average scale score for eighth graders in Hawaii in 1996 (262) was 
higher than that in 1990 (251). 



IP 

The NAEP mathematics scale ranges from 0 to 500. 

4 

The Proficient achievement level represents solid academic performance for each grade assessed. Students reaching this 
level have demonstrated competency over challenging subject matter, including subject-matter knowledge, application 
of such knowledge to real-world situations, and analytical skills appropriate to the subject matter. 
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Major Findings for Student Subpopulations 

The preceding section provided a global view of the mathematics performance of 
fourth- and eighth-grade students in Hawaii. It is also important to examine the average 
performance of subgroups within these populations. Typically, NAEP presents results 
for demographic subgroups defined by gender, race/ethnicity, parental education, and 
location of the school. In addition, in 1996 NAEP collected information on student 
participation in Title I programs and eligibility for the free/reduced-price lunch 
component of the National School Lunch Program (NSLP). 

The reader is cautioned against using NAEP results to make simple or causal 
inferences related to subgroup membership. Differences among groups of students are 
almost certainly associated with a broad range of socioeconomic and educational factors 
not discussed in NAEP reports and possibly not addressed by the NAEP assessment 
program. 

Results for 1996 related to gender and race/ethnicity are highlighted below. More 
complete results for the various demographic subgroups examined by the NAEP 
mathematics assessment can be found in Chapters 2 and 4 of this report, the NAEP 1 996 
Mathematics State Report for Hawaii. 

• The average mathematics scale score of fourth-grade males did not differ 
significantly from that of females in both Hawaii and the nation. 

• The average mathematics scale score of eighth-grade males was lower 
than that of females in Hawaii; nationwide, however, the performance 
of males did not differ significantly from that of females. 

• At the fourth grade, White students in Hawaii had an average 

mathematics scale score that was higher than that of Black and Hispanic 
students but was not significantly different from that of Asian/Pacific 
Islander or American Indian students. 

• At the eighth grade. White students in Hawaii had an average 

mathematics scale score that was higher than that of Hispanic and 
Asian/Pacific Islander students. 
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